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Control  of  a  Remotely  Operated  Quadrotor  Aerial  Vehicle  and 
Camera  Unit  Using  a  Fly-The-Camera  Perspective 


DongBin  Lee1,  Vilas  Chitrakaran2,  Timothy  Burg1,  Darren  Dawson1,  and  Bin  Xian3 


Abstract-  This  paper  presents  a  mission-centric  approach 
to  controlling  the  optical  axis  of  a  video  camera  mounted 
on  a  camera  manipulator  and  fixed  to  a  quadrotor  remotely 
operated  vehicle.  The  approach  considers  that  for  video 
collection  tasks  a  single  operator  should  be  able  to  operate 
the  systems  by  ”flying-the-camera”;  that  is,  collect  video 
from  the  perspective  that  the  operator  is  looking  out  of  and 
is  the  pilot  of  the  camera.  This  will  allow  the  control  of 
the  quadrotor  and  the  camera  positioner  to  be  fused  into  a 
single  control  problem  where  the  camera  is  positioned  using 
the  four  degree-of- freedom  (DOF)  quadrotor  and  the  two 
DOF  camera  positioner  to  provide  a  full  six  DOF  actuation 
of  the  camera  view.  The  closed-loop  controller  is  designed 
based  on  a  Lyapunov-type  analysis  and  is  shown  to  produce 
Globally  Uniformly  Ultimately  Bounded  (GUUB)  tracking  of 
a  desired  trajectory.  Computer  simulation  results  are  provided 
to  demonstrate  the  performance  of  the  suggested  controller. 

I.  Introduction 

The  potential  for  unmanned  aerial  vehicles  (LTAVs) 
in  applications  as  diverse  as  fire  fighting,  emergency 
response,  military  and  civilian  surveillance,  crop  mon¬ 
itoring,  and  geographical  registration  has  been  well 
established.  Many  research  groups  have  provided  con¬ 
vincing  demonstrations  of  the  utility  of  UAVs  in  these 
applications.  However,  there  is  still  a  large  chasm  be¬ 
tween  the  anticipated  “tool  of  the  future”  and  currently 
available  systems.  The  commercial  and  military  use  of 
UAVs  is  predicated  on  the  ability  of  such  vehicles  to 
perform  new,  safer,  or  more  cost  effective  tasks  than 
traditional  manned  aircraft.  Until  recently,  this  has  been 
more  of  a  question  than  a  statement;  however,  recent 
advances  in  aerial  vehicle  construction,  sensors,  digital 
electronics,  control  design  have  seen  a  rapid  increase  in 
UAV  applications. 

Aerial  vehicle  construction  should  be  considered  as  an 
important  factor  in  UAV  applications.  Improved  man¬ 
ufacturing  techniques  are  capable  of  producing  small, 
complex,  precise  parts  at  a  reasonable  price  and  new 
battery  technologies  have  made  electric  hovering  craft 
more  feasible.  One  of  the  interesting  small  aerial  vehicles 
that  seems  to  have  benefited  from  these  developments 
is  the  quadrotor  helicopter  depicted  in  Figure  2.  The 
quad-rotor  consists  of  four  independently  driven  rotating 
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blades  that  can  provide  lift  in  the  vertical  direction.  The 
vehicle  moves  in  other  directions  by  creating  a  mismatch 
between  rotor  speeds,  and  hence,  this  configuration  can 
produce  torques  about  the  roll,  pitch,  and  yaw  axes. 
The  basic  concept  for  the  quad- rotor  dates  back  to  1907; 
some  notes  on  the  history  of  the  quad-rotor  and  related 
references  can  be  found  in  [9].  With  this  as  a  backdrop, 
the  focus  of  the  work  presented  here  will  be  the  small 
quad-rotor  family  of  aerial  vehicles.  The  discussion  will 
be  limited  to  vehicles  with  less  than  0.5kg  payload.  This 
weight  restriction  means  that  certain  technologies  that 
may  make  sense  for  larger,  more  expensive  aircraft  may 
not  apply  to  this  class  of  aircraft. 

The  typical  scenario  for  using  the  quadrotor  helicopter 
(or  any  aerial  vehicle)  as  a  video  camera  platform  is  based 
on  mounting  the  camera  on  a  positioner  that  is  controlled 
independently  from  the  vehicle.  When  the  navigation  or 
surveillance  tasks  become  complicated,  two  people  may 
be  required  to  achieve  the  camera  targeting  objective:  a 
pilot  to  navigate  the  UAV  and  a  camera  operator.  It  is 
insightful  to  consider  the  actions  of  these  two  actors  in 
this  scenario  in  order  to  hypothesize  a  new  operational 
mode.  The  pilot  will  work  to  position  the  aircraft  to 
avoid  obstacles  and  to  put  the  camera  platform,  i.e., 
the  aerial  vehicle,  in  a  position  that  the  will  allow  the 
camera  operator  to  watch  the  camera  feed  and  move 
the  camera  positioner  to  track  a  target  or  survey  an 
area.  An  important  underlying  action  on  the  part  of  the 
camera  operator  that  makes  this  scenario  feasible  is  that 
the  camera  operator  must  compensate  for  the  motions  of 
the  LTAV  that  disturb  the  camera  targeting  as  illustrated 
in  Figure  1.  Additionally,  there  must  be  communication 
between  the  pilot  and  the  operator  so  that  the  camera 
platform  is  correctly  positioned  or  moved  to  meet  the 
video  acquisition  objective.  More  specifically,  the  camera 
positioning  problem  is  split  between  the  pilot  and  the 
camera  operator.  Since  the  operator  is  not  in  full  control 
of  positioning  the  camera,  she  must  rely  on  commands 
to  the  pilot  to  provide  movement  of  the  camera  platform 
for  motions  not  included  in  the  camera  positioner.  For 
example,  if  the  camera  positioner  is  a  simple  pan-tilt  and 
the  camera  operator  requires  translation  of  the  camera 
then  a  request  must  be  made  to  the  pilot  to  move  the 
camera  platform.  The  potential  shortcomings  of  this 
typical  operational  scenario  can  be  summarized  as:  i) 
multiple  skilled  technicians  are  typically  required,  ii)  the 
camera  operator  must  compensate  for  the  actions  of  the 
pilot,  and  iii)  it  is  not  intuitive  for  a  camera  operator 
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Fig.  1.  Diagrams  a  -  c  illustrate  the  effect  of  uncompensated  cam¬ 
era  platform  motion  on  the  camera  axis.  Diagrams  d  -  f  illustrate 
a  scenario  where  the  camera  positioner  is  used  to  compenste  for 
the  platform  motion  and  maintain  the  camera  view. 


to  split  the  camera  targeting  tasks  between  actions  of 
the  camera  positioner  controlled  by  the  operator  and 
commands  to  the  pilot. 

The  problem  of  providing  an  intuitive  interface  with 
which  an  operator  can  move  a  camera  positioner  to  make 
a  video  camera  follow  a  target  image  appears  in  many 
places.  The  difficulty  of  moving  a  system  that  follows 
a  subject  with  a  video  camera  was  recently  addressed 
in  [13]  where  operating  a  multilink,  redundant-joint 
camera  boom  for  the  movie  and  television  industry  is 
described.  The  interesting  result  from  this  work  is  that 
an  integrated  control  strategy,  using  a  vision  servoing 
approach  to  reduce  the  number  of  links  controlled  by 
the  operator,  can  improve  the  use  of  the  system.  The 
final  result  shows  an  unexperienced  operator  achieving 
the  same  tracking  result  as  an  experienced  operator; 
hence,  the  control  strategy  has  rendered  the  system  more 
friendly  to  the  operator.  The  salient  point  of  the  control 
strategy  is  that  there  is  independent  macro-  and  micro¬ 
positioning  of  the  camera  -  the  operator  controls  the 
course  positioning  and  the  vision  system  controls  the  fine 
positioning.  The  authors  suggest  that  the  same  approach 
could  be  used  for  other  camera  platforms;  however,  it 
is  required  that  the  system  have  redundant  positioning 
axes.  Additionally,  an  automated  vision  servoing  system 
may  not  be  desirable  for  general  reconnaissance  where 
the  target  is  not  known. 

A  different  perspective  to  this  same  basic  camera 
targeting  problem  was  presented  in  [1]  and  [10]  where 
the  camera  platform,  a  quadrotor  UAV,  and  the  camera 
positioning  unit  are  considered  to  be  a  single  robotic 
unit.  In  this  work  a  controller  was  developed  which  simul¬ 
taneously  controls  both  the  quadrotor  and  the  camera 
positioning  unit  in  a  complimentary  fashion.  Both  works 
show  combining  the  four  degrees-of-freedom  provided  by 


motion  of  the  quadrotor  helicopter  with  two  degrees- 
of-freedom  provided  by  a  camera  positioner  to  provide 
arbitrary  six  degree-of-freedom  positioning  of  the  on¬ 
board  video  camera.  The  work  in  [1]  is  actually  directed 
towards  providing  an  automated  means  of  landing  the 
quadrotor  through  the  vision  system  but  provides  an 
important  mathematical  framework  for  the  analyzing  the 
combined  quadrotor/camera  system.  The  work  in  [10] 
builds  on  [1]  to  show  the  design  of  a  velocity  controller  for 
the  combined  quadotor/camera  system  that  works  from 
operator  commands  generated  in  the  camera  field-of-view 
to  move  both  elements.  This  perspective,  which  will  be 
referred  to  as  the  fly-the-camera  perspective,  presents  a 
new  interface  to  the  pilot.  In  this  proposed  approach, 
the  pilot  commands  motion  from  the  perspective  of  the 
on-board  camera  -  it  is  as  though  the  pilot  is  riding 
on  the  tip  of  the  camera  and  commanding  movement  of 
the  camera  ala  a  six-DOF  flying  camera.  This  is  subtly 
different  from  the  traditional  remote  control  approach 
wherein  the  pilot  processes  the  camera  view  and  then 
commands  an  aircraft  motion  to  create  a  desired  motion 
of  the  camera  view.  The  work  proposed  here  exploits  this 
new  perspective  for  fusing  vehicle  and  camera  control. 
In  this  paper,  a  quadrotor  UAV  model  will  be  combined 
with  a  two-DOF  camera  kinematic  model  to  create  a 
fully  actuated  camera  frame  and  a  positioner  controller 
will  be  designed. 

The  paper  is  organized  as  follows.  In  Section  II,  a 
well  known  kinematic  and  dynamic  model  of  the  quad¬ 
rotor  is  presented.  The  dynamic  model  is  simplified  to 
include  only  the  translational  dynamics  of  the  quadrotor. 
Assumptions  and  properties  of  this  model  are  shown. 
The  kinematics  for  a  three-link  camera  positioner  are 
developed  as  a  means  of  studying  two  special  cases  that 
require  different  two-link  positioner  configurations:  when 
the  camera  is  looking  forward  and  when  the  camera  is 
looking  downward.  The  case  of  the  camera  looking  for¬ 
ward  is  carried  through  the  control  design  and  simulation 
while  the  second  case,  the  camera  looking  downward,  is 
a  simple  modification  of  the  first.  A  Lyapunov  function 
based  control  design  approach  is  detailed  in  Section 
III,  its  stability  analysis  is  shown  in  Section  IV,  and 
a  simulation  demonstrating  the  controller  is  presented 
in  Section  V. 


II.  System  Modeling 

A.  Underactuated  Quadrotor  Aerial  Vehicle  Model 

The  elements  of  the  quad-rotor  unmanned  aerial  ve¬ 
hicle  model  are  shown  in  Figure  2  and  Figure  3.  The 
quadrotor  is  assumed  to  be  a  rigid  body  on  which  thrust 
and  torque  act  uniformly  through  the  body  and  that  the 
quadrotor  body  fixed  frame,  F,  is  chosen  to  coincide  with 
the  center  of  gravity  which  implies  that  it  has  a  diagonal 
inertia  matrix.  The  kinematic  and  a  dynamic  model  of 
a  quadrotor  expressed  in  the  body-fixed  reference  frame 


are  as  follows  [4] ,  [1] 
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linear  velocity  of  the  quadrotor  body-fixed  frame  with 
respect  to  the  earth-fixed  inertial  frame,  I,  expressed  in 
the  body-fixed  frame,  F,  and  uifF(t)  =  [ux,  coy ,  u)z]T  £  R3 
denotes  the  angular  velocity  of  the  quadrotor  body-fixed 
frame  with  respect  to  the  inertial  frame,  /,  expressed  in 
the  body-fixed  frame,  F .  Equations  (1)  -  (3)  represent 
the  kinematics  of  the  quad  rotor  and  include  the  approx¬ 
imation  that  the  rotational  dynamics  are  negligible.  The 
time  derivative  of  position,  p\F  (t)  in  (1),  is  the  velocity 
of  the  quadrotor.  In  a  similar  manner,  the  angular 
derivative  0}F(t)  in  (2)  represents  the  angular  velocity 
ixfF(t)  transformed  by  the  matrix  TF  (0).  Equation  (2) 
represents  the  modeling  assumption  that  angular  velocity 
of  the  quadrotor  is  calculated  directly  in  lieu  of  modeling 
the  angular  dynamics;  that  is,  u>fF(t )  is  considered  as  the 
system  input.  The  dynamics  of  the  translational  velocity 
is  shown  in  (4)  and  contains  the  gravitational  term, 
G(RF),  which  is  represented  in  the  body-fixed  frame  as 

G(i?F)  =  mg(RFy  E3  £  M3  (5) 


where  g  £  l1  denotes  gravitational  acceleration,  E$  = 
[0,0, 1]T  denotes  the  unit  vector  in  the  coordinates  of 
the  inertial  frame,  m  £  M1  is  the  known  mass  of 
the  quad-rotor,  Ni  (yjF)  £  M3  represents  a  bounded, 
unknown,  nonlinear  function  (i.e,  aerodynamic  damping) 
and  S(-)  £  R3x3  is  a  general  form  of  the  skew-symmetric 
matrix  as  follows 
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The  quadrotor  has  inherently  six  degrees-of-freedom  as 
shown  in  Figure  2:  three  translations  in  the  x,y,  and  z 
directions  and  three  rotations  about  the  roll  ((/>),  pitch 
( 9 ),  and  yaw  (ip)  axes.  However,  the  quadrotor  has  only 
four  control  inputs:  one  translational  force  along  the  z- 
axis  and  three  angular  velocities.  The  vector  F 'J  ( t )  €  R3 
refers  to  the  quadrotor  translational  forces  expressed  in 
the  quadrotor  frame  but  in  reality  represents  the  single 
translational  force  which  is  created  by  summing  the 
forces  generated  by  the  four  rotors  and  is  expressed  as 


Ff  =  B\U\  =  [  0  0  Ul  ]T  (7) 

where  u\(t)  €  R1. 


B.  Camera  Positioner  Kinematics 


Fig.  2.  An  underactuated  quadrotor  vehicle 


The  camera  positioner  will  be  used  to  augment  the 
camera  position  with  two  additional  degrees-of-freedom 
(compared  to  a  camera  fixed  directly  to  the  quadrotor 
frame).  This  general  three- axis  camera  positioner  will 
provide  for  a  Tilt-Pan-Roll  motion  and  the  variables 
9 tut (t),  0Pan(t),  and  9rou(t)  will  be  used  to  represent  the 
Tilt,  Pan,  and  Roll  angles,  respectively.  The  Tilt-Pan- 
Roll  motion  can  be  reduced  to  two  special  operational 
cases  of  Tilt-Roll  and  Pan-Tilt  by  freezing  (holding 
constant)  one  of  the  joints  as  shown  in  Figure  3.  The 
Tilt-Roll  configuration  can  be  used  to  compensate  for 
the  quadrotor  body  roll  and  pitch  when  the  camera  is 
facing  forward  for  tasks  such  as  general  navigation  or 
surveillance.  In  the  Pan-Tilt  mode,  the  camera  positioner 
is  also  used  to  compensate  for  quadrotor  body  roll  and 
pitch  while  the  camera  is  facing  downward  for  landing 
or  surveillance  tasks.  For  both  of  these  configurations, 
the  camera  optical  frame,  which  is  actuated  by  the 
combination  of  the  quadrotor  and  the  camera  positioner, 
is  fully  actuated.  The  dynamics  of  the  camera  unit  will  be 
considered  negligible  and  that  the  angles  of  the  camera 
positioner  can  be  commanded  directly  without  error. 

In  order  to  facilitate  the  development  of  the  rotation 
matrices  for  the  manipulator  in  Figure  3,  standard 
coordinate  system  definitions  are  made.  Specifically,  Oo  is 
used  to  represent  the  origin  of  a  coordinate  system  at 
the  base  of  the  camera  and  coincident  with  camera 
positioner  base  coordinate  system  B  and  O3  is  the  origin 
of  a  coordinate  system  attached  at  the  third  link  and 
coincident  with  camera  frame  denoted  C.  Note  that  this 
matrix,  R^(9c)  represents  a  static  mounting  on  the 
quadrotor  and  is  given  by 
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To  create  a  general  analytic  framework  for  modeling 
various  mounting  configurations  of  a  two-link  revolute 
positioner  a  3-link  robot  manipulator  model  is  proposed. 


The  camera  positioner  unit  is  considered  to  have  coin¬ 
cident  rotational  links,  thus  the  link  lengths  are  zero 
(a  =  0  in  Table  I). 
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The  Jacobian  matrix  J'c(0c )  €  R3x3  in  (11)  can  be  built 
from  the  rotation  matrices  with  the  final  result  given  by 
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excise  2’  Pan-Tilt 
Case  1:  Tilt-Roll  Configuration  (0  =0°)  Config.(0r=O°) 


(13) 

where  Zi  are  the  columns  of  the  rotation  matrices  as 
specified  in  [12].  By  way  of  example,  the  third  column 
in  (8)  is  the  z o  vector  in  J'C(0C).  To  simplify  the  use 
of  the  Jacobian  matrix  in  later  developments,  it  can  be 
noted  that  9p(t)  =  0  (since  it  assumed  to  be  constant) 
and  hence  a  new  reduced  position  joint  angle  vector  can 
be  introduced  as 


0c  = 


e , 


and  9  c  = 


9t 


(14) 


Fig.  3.  Quadrotor  with  a  Pan-Tilt-Roll  camera  positioner. 


along  with  a  reduced  Jacobian  matrix,  Jc{9c)  6  R3x2, 
defined  as 


1)  Case  1:  Tilt-Roll  Camera  Configuration  (camera 
looking  forward):  The  Denavit-Hartenburg  table  for  the 
Tilt-Roll  configuration  in  Figure  3  is  shown  in  Table  I. 
The  Tilt-Roll  camera  positioner  is  obtained  by  freezing 
the  second  manipulator  joint.  The  link  rotation  matrices 
can  be  obtained  using  standard  results  [12]  and  setting 
9p(t)  =  0  yields  the  modified  result 


Jc  =  Rb  [  zo  z2  ] 


0  cos  9t 
1  0 
0  —  sin  9t 


(15) 


The  total  rotation  matrix  from  the  camera  frame  to 
the  inertial  frame  can  be  obtained  using  the  previous 
equations  as 


R'c  =  RtpR 


F 

C 


(16) 


R 


1 

2 


0  0  1 
-10  0 
0-10 


{9P  =  0°). 


(9) 


The  total  rotation  matrix  from  the  quadrotor  through 
the  3rd  link  can  be  obtained  as 


R 


F 

C 


RFBR?=°°R\Rl=c  (10) 

—  sin  9t  cos  6r  sin  9t  sin  9r  cos  9t 

sin#,.  cos  9r  0 

—  cos  9t  cos  9r  cos  9t  sin  9r  —  sin  9t 


and  the  desired  rotation  matrix  expressed  in  inertial 
frame,  Rp.d(Q,9c),  can  be  defined  in  the  following 
manner 

Red  =  FFRFRQd.  (17) 

Hence,  the  rotation  matrix  between  the  camera  frame 
and  the  desired  frame  can  be  obtained  using  measurable 
rotations  as 

Red  =  {R'c)  Red 

=  {R§Rf)  RpRcRcd-  (18) 


Link 

d  (offset) 

a  (length) 

at  (twist) 

da  (angle) 

i 

0 

0 

-90° 

Bt 

2 

0 

0 

-90° 

0P  -  90° 

3 

0 

0 

0° 

9r  -  90° 

TABLE  I 


Denavit-Hartenburg  Table  for  a  Tilt-Roll  Camera  Positioner 

The  angular  velocity  of  the  camera  frame  can  be 
written  as  follows 

WBC  =  R'B^BC  =  RbJ9c  =  J'c^C  (11) 


Remark  1:  The  more  details  are  shown  in  Appendix 
B  and  a  similar  approach  can  be  followed  to  develop  the 
kinematics  for  the  Pan-Tilt  configuration. 

C.  Translation  and  Orientation  of  the  Camera  Frame 

The  objective  is  to  control  the  motion  of  the  camera 
optical  axis.  Towards  this  end,  the  kinematic  relation¬ 
ships  in  (1)  -  (3)  will  be  extended  to  include  the  action 
of  the  camera  positioning  unit  and  to  obtain  the  position 
and  orientation  of  the  camera.  The  derivative  of  the 
position  of  the  camera  in  the  camera  frame,  C,  with 


respect  to  the  inertial  frame,  I,  and  expressed  in  the 
inertial  frame,  (t)  €  M3,  is  defined  as 

Pic  =  Rcv?c  (19) 

where  vfc(t)  €  R3  is  the  linear  velocity  in  the  camera 
frame,  C,  referred  to  inertial  frame,  /,  and  expressed  in 
the  camera  frame,  C.  The  velocity  vfc(t)  can  be  divided 
into  two  components  as  follows 

Rcv?c  =  R-c  ( v?f  +  vfc ) 

=  Rq  ( Rpi’fp  +  RpVpC ) 

=  RWf  (20) 

where  the  fact  that  vFC(t)  =  0  is  used,  since  the  camera 
positioning  unit  only  has  rotational  axes  and  does  not 
translate  from  the  quadrotor  body.  The  desired  camera 
position  trajectory,  pjCd{t)  €  M3,  is  generated  via 

Pied  =  Rcv?cd  (21) 

where  vfcd(t)  €  M3  is  a  desired  input  velocity  vector. 

The  second  equation  of  (2)  uses  a  Jacobian  matrix 
Tp  (0)  to  relate  the  rotational  velocity  in  the  quadrotor 
frame  to  the  rotational  velocity  in  the  inertial  frame. 
This  relationship  can  be  used  to  solve  for  QjF(t)  as 

OjF  =  [  T^(Q)  cuf Fdt  (22) 

Jo 

where  Q\F  (t)  =  \  <p  9  ip  1 T  €  M3  represents  the  roll, 
pitch,  and  yaw  angles  between  the  quadrotor  frame  and 
inertial  frame  as  described  in  [4].  The  exact  form  of 
Tp(Q)  can  be  expressed  as  follows 

f  sin  <p  tan  9  cos  (p  tan  9 
Tp(Q)  =  0  cos  (p  —  sin</>  .  (23) 

0  sin  (p/  cos  9  cos  <p/  cos  9 

A  similar  result  is  now  shown  for  the  camera  angle, 
0}c(f).  The  Jacobian  matrix  TF(Q)  is  used  to  relate 
the  rotational  velocity  of  the  camera  in  the  quadrotor 
frame  to  the  rotational  velocity  in  the  inertial  frame  as 

QjC  =  Tf  (0)  ufc 

=  Tp  (0)  (24) 

and  decomposing  the  angular  velocity,  ufc(t),  yields 

QjC  =  Tp  (0)  Rq  (u>fp  +  Wpc) 

—  Tp  (0)  Rq  (c JfF  +  (ojFB  +  WflC)) 

=  Tp  (0)  RF  ( Rpufp  +  R^uipB  +  RptvBC) 

=  Tp  (0)  (ujfF  +  RBuiBC) 

=  Tp  (0)  cofp  +  T:f  (0)  RfbJ9c  (25) 

where  RFRF  =  1  and  u)FB(i)  =  0  since  the  camera  base 
is  rigidly  mounted  on  the  quadrotor  frame.  The  definition 
JC  =  RBJ{t)  is  introduced  into  (25)  to  yield 

QIIC  =  TIp(Q)u1ip  +  TIp{Q)Jc9c  (26) 

where  Jc9c(t)  was  defined  in  (15)  as  the  camera  kine¬ 
matics.  Finally,  following  the  same  approach  the  desired 


camera  angle,  0/cd(t),  is  obtained  from  the  desired 
angular  velocity  of  the  camera  in  the  quadrotor  frame, 
W/cy(t).  as 

®ICd  =  Tp  (0)  Lofcd 

=  Tp  (0)  RFu!<pCd.  (27) 

The  changing  rate  of  Rq(Q), i.e. ,  Rq(Q),  is  obtained 
as  follows 

Rc  =  RcS^fc)  (28) 

thus 

R?  =  [Rhs^c)]1 

=  ST(LU<fc)RC 

=  -S(u>?c)R?.  (29) 

D.  Model  Assumptions 

The  following  assumptions  are  made  regarding  the 
system  model: 

Al:  The  position  p\p{t)  and  velocities  vif(J)i 

wfF(t)  are  measurable  and  the  angles  of  the 
quadrotor  and  Pan-Tilt-Roll  camera  unit  are 
also  measurable. 

A2:  The  quadrotor  frame  expressed  in  F,  camera 

base  expressed  in  B ,  and  camera  frame  C  are 
all  coincident  since  the  link  lengths  and  link 
offsets  are  assumed  to  have  zero  length.. 

A3:  Rp(O)  and  TF  (0)  are  full  rank,  i.e.,  9(t)  ^  ±f 
so  that  [4] .  This  will  ensure  that  the  orientation 
angle,  a(f),  (defined  later)  remains  within  the 
range  0  <  a(t)  <  2tt  about  the  rotation  axis 
li{t)  and  will  ensure  that  det(Lu)  exists. 

A4:  The  desired  camera  trajectories  and  the  first 

derivatives  are  all  bounded;  i.e.,  p\cd W, 
v?Cd  (*) .  and  ufCd  (t)  €  Coo- 

A5:  Ni (vfF)  in  (4)  can  be  replaced  by  the  lin¬ 

early  parameterized  form  Yi{vfF)9\  =  NA  (vfF) 
where  Y\(vfF)  €  M3xrl  is  a  known  regression 
matrix  and  9±  €  1"  is  a  known  parameter 
vector.  Additionally,  ^Y\(vfF)9\  ||  <  Ci(||'1’/f||) 
—  Ci  ||<f||  where  Ci  is  a  positive  function 
and  non-decreasing  in  ||u|^||  and  ^  €  M1  is 
a  positive  constant. 

III.  Control  Method 

Figure  4  demonstrates  the  culmination  of  the  modeling 
effort  to  combine  the  quadrotor  and  camera  positioner 
to  create  a  means  of  fully  actuating  the  camera  optical 
axis.  In  this  diagram,  it  can  be  seen  that  the  camera  is 
positioned  and  oriented  by  using  the  two  camera  posi¬ 
tioner  angles  (selected  from  9tiit(t),9roii{t),  and  9pan{t) 
according  to  configuration),  the  quadrotor  linear  force, 
F(t),  and  the  quadrotor  angles  (proU{t),9pitch(t),  and 
i’yawi't)  by  wz(i),wy(f),  and  uz(t)  from  (2).  In  keeping 
with  the  fly-the-camera  objective,  a  controller  will  be 
designed  based  on  these  inputs  to  move  the  camera 
optical  axis  along  a  desired  trajectory.  A  control  strategy 


Fig.  4.  The  Camera  Optical  Axis  is  fully  actuated  by  two  camera 
positioner  angles,  a  linear  force,  and  the  three  angular  velocities. 


will  be  proposed  to  control  the  camera  translational 
position  error,  ep(t)  £  R3,  and  the  camera  orientation 
error,  eg{t)  £  M3. 

A.  Open-Loop  Error  Formulation 

The  camera  translational  position  error,  ep(t),  is 
defined  in  the  camera  frame  (C)  as  the  transformed 
difference  between  the  inertial  frame  (/)  based  camera 
position,  PjC(t),  and  the  inertial  frame  based  desired 
camera  position,  denoted  as  Pjcdif)  £  R3,  as  follows 

eP  —  R?  ( Pic  ~  Pica )■  (30) 

The  camera  translational  position  error  rate,  ep  (t)  £  R3, 
is  obtained  by  taking  the  time  derivative  of  (30)  to  yield 

ep  =  Rf  (pjc  -  pjcd)  +  R? ( Pic  ~  Pied )  (31) 

where  pTIC(t )  and  p(C(<(t)  were  introduced  in  (19)  and 
(21),  respectively.  Substituting  (29)  into  the  first  term 
in  (31)  yields 

R?  ( Pic  ~  Pied )  =  ^'^(UJ?c)R?  (Pic  —  Pied) 

=  —S(ujfc)ep.  (32) 

and  the  term  RfpjC(t)  in  (31)  can  be  rewritten  in  terms 
of  the  quadrotor  velocity,  vfF  (t) ,  as 

R?  Pic  =  R?  (Rcv?c) 

=  vfF  +  vFC 

=  Rpvfp  (33) 

with  v pC  =  0,  i.e. ,  all  translation  of  the  camera  is  the 
result  of  the  quadrotor  translation.  The  final  term  in 
(31)  is  rewritten  as 

RjPiCd  =  R?  ( Rcv?Cd ) 

=  vfCd.  (34) 

Substituting  (32),  (33),  and  (34)  into  (31)  yields 

ep  =  —S(u>fc)ep  +  Rpvfp  —  vfCd.  (35) 


To  further  the  controller  development,  a  filtered  error, 
r(t)  £  R3,  is  introduced  as 


where  the  filtered  position  error,  rp{t)  £  R3,  is  defined 
as 

v P  =  kpep  +  Rpvfp  +  Rp8  (37) 

in  which  S  =  [  0  0  6^3  ]T  £  R3  is  a  constant  design 
vector.  The  orientation  tracking  error  signal,  eg(t)  £  R3, 
is  defined  in  terms  of  the  angle-axis  representation  of  the 
rotation  matrix  between  the  desired  and  actual  camera 
orientations,  R^d{t),  [1]  as 

eg  =  ap  (38) 


where  the  scalar  angle  a(0)  is  obtained  from 

a  =  cos”1  Q(Tr(i?gd)  -  1)^  e  R1,  (39) 


in  which  Tr(i?.gd)  defines  the  trace  of  the  matrix  i?gd(0), 
and  the  unit  length  axis  of  rotation  p(0)  £  R3  defined 
as 


P  = 


1 

2  sin  a 


(?’32  -  r23) 
(?’i3  -  r3i) 

ix 21  -  r12) 


(40) 


for  which  ||p||2  =  1.  In  this  representation,  the  rotation 
angle  a(0)  is  assumed  to  stay  within  the  range  0  < 
a(0)  <  27t.  Note  that  the  terms  on  the  right-hand  side 
of  the  definition  in  (40)  come  from  i?gd(0)  as 


ru 

r  12 

r  13 

r2 1 

r-22 

?’23 

r3i 

V32 

?'33 

(41) 


Substituting  the  axis-angle  representation  from  (39)  and 
(40)  into  (38)  yields 


1 

2  sinc{cos~1(^(Tr(Rp,d)  —  1))} 


L52  —  ^23 
1 13  -  r-3i 


r-2i  -  r  12 

(42) 


sin(a) 

where  sinc(a)  = - . 

a 

The  angular  error  rate  can  be  obtained  by  taking  the 
time  derivative  of  (38)  as 


—  Lu^ccd  e  R3  (43) 


where 


Ruj  —  -I3 


|S(M)  + 


sinc(a )  \ 
sinc2(f ) ) 


S2(p) 


(44) 


in  which  S(p)  is  a  skew  symmetric  matrix  defined  as 


S(p)  = 


2  sin  a 


(45) 


Details  for  obtaining  of  (43)  -  (45)  can  be  found  in  [8]  and 
[5].  The  term  u>QCd(t)  £  R3  introduced  in  (43)  represents 


the  angular  velocity  of  the  desired  camera  frame  relative 
to  the  actual  camera  frame  as 


By  taking  the  time  derivative  of  r(t)  in  (36)  and 
substitute  (47)  and  (55)  it  can  be  obtained  that 


JCCd 


■  00, 


CI  +  u?Cd  - 

=  —RF(uofF  +  u>F 


=  LO 


C 

ICd 


Rcf{“ 


FB 

F 

IF 


IC 
•  id 


■  id 


ICd 


—  -Rpufc  + 


BC 


,C 


-  LO 


BC 


)• 


)  +  w  ICd 


LO 


ICd 


(46) 

where  the  rigid  connection  of  the  manipulator  to  the 
base  requires  ooFB{t)  =  0.  Substituting  (46)  along  with 
(11),  (14),  and  (15)  into  (43)  produces 

■F  RWbc)) 

r  h  (47) 


ee 


—  Lu  (io'fcd 


RpOjjp 


—  Lu jOJ^cd  LuRplOjp  LuRpJr.Or. 


Taking  the  time  derivative  of  rp(t)  in  (37)  yields 


7  _  uC-f 
ip  —  *^fu  IF 


Rpvfp 


kp6p 


Rp6. 


(48) 

Substituting  from  (4)  and  (35)  into  (48),  utilizing  the 
fact  that  Rp  (0)  =  RFS( ooFF)  =  — RfS(lofc )  ,  and 
subtracting  and  adding  RpS(ufF)8  yields 

fp  =  Rp  [^Ni(vfp)  —  S(u)fp)vfp  +  gRfE3  +  ^FF] 


+kp  [Rd 


-p  [y  vfvif 

S(ujpC 


S(i 


,c 


Jic)ep  ~  V?Cd]  T  1LFL 
-  Rcp  (yS{uipC)  +  S(iofp))  5(49) 

Combining  the  angular  velocities  represented  by  the 
second  term  in  the  first  row  of  (49)  and  the  first  term 
in  the  last  row  of  (49)  yields 

—Rp  {S(wfF)  +  S(oJpC))  vfF 
=  —RpS  (u)fp  +  LOpc)  vfp 
=  —RpS(u)fc)v[F.  (50) 

The  right-hand  side  of  (50)  can  be  further  clarified  using 


■B%S(ufF)6 


-Rp 


)u 


F 

IF 


id 


IC 


=  RZloc 


ic(t)  and 

S(wIc)  = 


S(RpUJ<fc) 

RpS(u>fc)Rp- 


(51) 


to  yield 


(52) 


—Rp  (S(wfF)  +  S(lo pC ))  vfF 

=  —RpRcS(Lofc)  Rpvfp 
=  —  S  (uoB c)  Rpvfp. 

Combining  the  angular  velocity  terms  LOFC(t)  and  oofF(t) 
in  the  last  terms  of  the  last  row  in  (49)  with  uifc(t)  yields 

-Rcp  (S{<4.c)  +  S(ufF))  8  =  —RpS  (uofp  +  LOpC)  8 

=  —RpS(Lofc)6 
=  —RFS(RFu>fc)8 
=  —RpRFS(cofc)Rp8 
=  — S(lo<]:c)RfS .  (53) 

Multiplying  both  sides  of  (37)  by  S(oofc)  yields 
— S (u)<jc)rp  —  —S{u)fc)  (kpep  +  Rpvfp  +  RF8)  .  (54) 
Substituting  (52),  (53),  and  (54)  into  (49)  yields 

rp  =  ^N.iv^-Sicofcyp  +  gRlEs  +  ERCFF 

+kp Rpvfp  -  kpvfCd  -  RpS(8)LofF.  (55) 


r  = 


'  p 


c  )r 

O  3X1 

Cl 
F 1 


S(lo‘iC 


■^RpN^vfp 


£ Rcff 7  ~  R3S(8)uf 


IF 


kpvfcd 

Luffed 


-LuRcflofc  -  LuR§Jc0c 

)  +  kpRpvfp  +  gRf  E3 
O  3X1 


(56) 

Arranging  the  last  term  in  the  first  row  of  (56)  yields 


—RpFf 
m  r  j 

-LuRpU>  fc 


RfS(8)'  'F 


IF 


LuRCjc0c 


=  L, 


Rp 

03x3 

,BU 


03x3 

—  L, 


Rp 


EBl,-S(8),03x2 

Osx  I  ,  7j>:  3 ,  Jc 


1 

Ml 

L0Fp 

- 

Or. 

where  L w  €  R6x6  is  defined  as 


Lu,  = 


Rp 


B{t)  e 
B  = 


03x3 
,x6  is  defined  as 


03x3 

-LuRcf 


J-B1 

m  x 

- 

5(5) 

03x2 

03x1 

hx3 

J c 

0 

0 

+53 

—82 

0 

0 

0 

—  53 

0 

+83 

0 

0 

J_ 

m 

+52 

-Si 

0 

0 

0 

0 

1 

0 

0 

0 

cos  0t 

0 

0 

1 

0 

1 

0 

0 

0 

0 

1 

0 

—  sin0f 

(57) 


(58) 


(59) 


,(60) 


and  U(t)  €  R6  is  given  by 


U  = 


L0 


U 1 
F 


IF 


Or. 


(61) 


It  should  be  noted  that  the  final  form  of  B{t)  in  (59) 
represents  the  point  where  the  specifics  of  the  Tilt- 
Roll  Jacobian,  Jc(t),  are  explicitly  used,  the  Pan-Tilt 
configuration  will  require  a  different  B(t).  The  new  term 
B{t)  is  introduced  as 

B  =  LUB  (62) 

along  with  the  new  term  U(t)  =  [  Uj  C/J  ]T  €  R6, 
where  U\{t)  €  R3  and  U2(t)  €  R3,  defined  also  further 
clarify  the  control  design  procedure. 

U  =  BU.  (63) 

Substitution  of  (62)  and  (63)  into  (57)  and  then  substi¬ 
tution  of  the  resulting  form  of  (57)  into  (56)  produces 
the  open-loop  filtered  error  dynamics  as  follows 

-S(u>fc)rp 

03x1 


+ 

'  Ui  ' 
.  ^2  . 

- 

kpvfcd 

I  1  )C 
C^OJicd 

’fp)  +  kp  Rpvfp  +  gRfEs 

(64) 


03X1 


where  R^Rf  =  I3  is  used  and  it  is  clear  that  the 
control  inputs  Ui(t)  and  U2(t)  will  be  designed  to  meet 
the  control  objective.  Note  that  implementation  of  the 
control  while  require  U{t)  which  is  obtained  from 

U  =  R-XU  €  M6  (65) 


requires  B  1  =  B 

(Lu 


\Luy 

1 

A(ZW) 


where 

-KRcf 

^3x3 


03x3 

Rcf 


(66) 


Substituting  (71)  and  (73)  into  (70)  yields 


V  =  rl(N1- 
-rlS{ujfc)rp 


-)  -  krrJprp  -  rj,kpvfcd  -  kge] 


eg 


-  eJ<SV/c)eP  -  kpelep  -  el(R%6  +  vfCd). 

(75) 


IV.  Stability  Analysis 

Theorem  1:  The  closed- loop  control  law  of  (71)  and 
(73)  ensure  that  the  tracking  error  is  Globally  Uniformly 
Ultimately  Bounded  (GUUB)  in  the  manner 


in  which  A (Lu)  =  —RpL^Rp  is  the  determinant  of  the 
matrix  L^it)  and  A(LW)  y  Oqxq  due  to  Assumption  A3. 


B.  Control  Design 

The  non-negative  scalar  function  V(t)  is  chosen  as 

V  =  \r1r  +  ^e1pep.  (67) 

Differentiating  yields 


V  =  rTf  +  eJ,ep,  (68) 

by  substituting  (35)  and  (64)  into  (68)  it  can  be  obtained 
that 


v  =  fa.ej] 


-S(uc 


IC)rP 
03xx 


£4 

U2 


mR%Ni(vjp)  +  kpR^vfp  +  gR?E3  -  kpvfCd 


U  j  jp 

Luffed 


+el  [S(uiC)eP  +  (rP  -  kpep  -  R%6)  -  vfCd] 

(69) 

where  (37)  was  utilized.  The  terms  in  (69)  can  be 
collected  to  yield 


V  =  [~rlS(ufc)rp  +  irlRCN^vfp)  +  r^R^fp 
+rp£4  +  rTgRfEs  -  rlkpvfCd  +  eTprp  -  elS(u?c)ep 

- kPelep  -  eJ,Rp6  -  elvfCd,  e]U2  -  eJLc,wfCd]. 

(70) 

Equation  (70)  will  be  utilized  to  design  the  control 
inputs  U\(t)  and  U2(t).  From  the  upper  equation  in  (70) 
we  can  design  XJ\{t)  to  subtract  out  four  terms,  add 
stabilizing  feedback,  and  add  robust  compensatation  for 
the  unknown  nonlinear  term  as  follows 

Ux  =  -krrp~rpCl^vJF^  +kpR$vfF-gR?E3-ep  (71) 


where  £0  is  a  positve  constant,  Assumption  5  is  used  for 
Cl  (|Kf||)  >  and  the  nonlinear  term  Ni(t)  is  defined  by 

Nx  =  ±RcFNx(yJF).  (72) 


From  the  lower  equation  in  (64)  U2(t)  can  be  designed 
as 


U2  —  kgeg.  (73) 

Next,  substituting  these  designed  control  inputs  (71)  and 
(73)  into  (64),  we  can  get  the  closed-loop  filterd  error 
design  based  on  Lyapunov  stability  analysis  as  follows 

r  =  [-S(ejfc)rp-krrp~ rpCl ^  +Nx-kpvfCd,  -kgeg}. 

(74) 


\v\\  <  \j ||??(0)||2e-2A2t  +  ^ 


where 


A  r  T  T  Til 

V  =  K  ,  eg  ,  e  ] 


(76) 

(77) 


£4  is  a  positive  constant,  and  A2  is  a  positive  constant 
given  by  the  following  form 


A2  =  min{(fcr  -  ^),  (kp  -  ,  kg}  (78) 

where  Ao,  Ai  are  positive  constants  under  the  conditions 
that 

kr  >  4r  and  kp>  (79) 

A  proof  of  the  theorem  is  given  in  Appendix  A. 


V.  Simulation 

A  two  computer  system  was  built  to  simulate  the  pro¬ 
posed  controller  as  shown  in  Figure  5.  The  first  computer 
is  configured  to  run  QNX  Real-Time  Operating  System 
(RTOS)  and  host  the  QMotor  [11]  control  and  simulation 
package  while  the  second  computer  is  configured  to  run 
Windows  XP  and  host  the  FlightGear  (v0.9.10)  [3]  open- 
source  flight  simulator  package.  A  QMotor  program  was 
written  to  simulate  the  rigid  body  kinematics  dynamics 
and  the  feedback  control.  The  output  of  the  dynamics 
simulation  is  sent  via  UDP  to  set  the  aircraft/camera 
position  and  orientation  in  the  FlightGear  virtual  world 
(note  that  FlightGear  is  used  only  as  a  graphics  proces¬ 
sor).  The  desired  trajectories  are  input  by  the  opera¬ 
tor  using  a  6DOF  joystick  (Logitech  Extreme  3D  Pro 
[6]).  Specifically,  the  operator  indirectly  supplies  the 
desired  position  trajectory  used  by  the  controller  through 
monitoring  the  simulated  camera  view  and  using  the 
joystick  to  command  the  velocities  that  move  the  camera 
view  in  the  virtual  world.  The  three  inputs  on  the 
joystick,  labeled  as  x,  y,  and  twist,  are  used  to  generate 
and  control  either  three  translational  velocities,  vfCd  ( t ), 
or  the  three  angular  velocities,  u)(fcd  (t)  depending  on 
trigger  position.  That  is,  the  magnitude  and  direction 
of  these  quantities  is  derived  from  the  joystick  position. 
The  velocity  commands  are  then  integrated  to  produce 
the  desired  position  trajectory  used  by  the  controller.  A 
typical  scene  from  FlightGear  is  shown  in  Figure  6  where 
the  quadrotor  is  tilted  but  the  camera  view  seen  by  the 
operator  remains  level. 

The  quadrotor  simulation  was  developed  to  approx¬ 
imate  the  parameters  of  the  DraganFlyer  X-Pro  [2]. 
Parameters  such  as  mass  (to)  and  saturation  limits  for 


Fig.  5.  Overview  of  components  in  simulation  system. 


Fig.  6.  The  “fly-the-camera”  view  used  by  the  operator  and  an 
outside  view  of  the  quadrotor  position. 


control  inputs  are  found  in  [10].  The  control  gains  are 
chosen  to  be 


kr 

m 

^l_max 
@tilt_  max 


ke  =  diag{  1,1,1),  kp  =  diag(  1,1,5), 
2.72 [kg]  and  g  =  9.81  [in3 /kgs2], 

35.586  [ Nm ], 

@roll  _  max  —  4.067  [Nm]  (80) 


In  order  to  orient  the  simulated  quadrotor  and  camera 
systems  with  the  virtual  world,  a  desired  rotation  matrix 
between  the  camera  frame  (C)  and  Flight  Gear  frame 
( G )  was  defined  as 


R 


c 

Cd=G 


0  0-1 

0  1  0 

1  0  0 


(81) 


A  short  timespan  of  the  simulation  was  captured  to 
demonstrate  the  operation  of  the  system.  The  simulation 
results  shown  in  Figure  15  and  Figure  16  and  displayed 
in  Figure  1  demonstrate  that  the  camera  and  quadrotor 
move  in  opposite  directions  to  acheive  the  fly-the-camera 
perspective.  Figure  7  shows  the  position  errors  about 
the  coordinates  ( x,y,z )  and  Figure  8  shows  the  position 
tracking  of  the  quad- rotor  to  the  desired  trajectory  Pd{t) 
in  (30).  The  actual  quad- rotor  trajectory  represented  by 
the  blue  line  follows  the  desired  trajectory  represented 
by  the  red  line  which  is  commanded  to  go  up  at  the 
first  time  and  then,  move  to  forward  and  again  go 


forward  near  the  end  to  the  Pd(t).  Figure  9  shows  the 
filtered  tracking  errors  in  (37).  Figure  10  shows  the 
control  inputs.  The  translational  force  input  u±(t)  of  the 
quadrotor  is  collectively  steady  after  having  transient 
states  in  order  to  track  the  desired  trajectory.  Torque 
inputs  are  given  to  turn  left,  right,  and  to  tilt.  The 
camera  torque  inputs  in  the  two  bottom  figures  are 
shown  for  tilting  and  rolling.  Figure  11  shows  the  velocity 
tracking  errors  in  (35)  by  the  results  of  Figure  12.  Figure 
13  shows  the  angular  velocity  tracking.  Figure  14  shows 
the  angle-axis  signal  of  (38)  in  camera  frame.  Figure  15 
shows  the  angles  of  the  Tilt-Roll  manipulator  in  (14)  and 
Figure  16  shows  the  Euler  angles  about  roll,  pitch,  and 
yaw  of  quadrotor  quadrotor;  OjF(t)  in  (23). 

VI.  Conclusion 

This  paper  suggests  a  novel  fly-the-camera  approach 
to  designing  a  nonlinear  controller  for  an  underactuated 
quadrotor  aerial  vehicle  that  compliments  the  quadrotor 
motion  with  two  additional  camera  axes  to  produce 
a  fully  actuated  camera  targeting  platform.  The  fly- 
the-camera  approach  should  provide  a  more  intuitive 
perspective  for  a  remote  pilot  to  operate  the  quadrotor 
vehicle  and  camera  for  surveillance  and  navigation  tasks. 
The  approach  fuses  the  often  separate  tasks  of  vehicle 
navigation  and  camera  targeting  into  a  single  task  where 
the  pilot  sees  (and  flies)  the  system  as  through  riding 
on  the  camera  optical  axis.  The  controller  was  shown 
to  provide  position  and  angle  tracking  in  the  form  of 
Globally  Uniform  Ultimately  Bounded  (GUUB)  result 
using  measurable  position  and  velocity  information  as 
state  feedback.  Simulation  results  were  shown  as  initial 
validation  of  the  proposed  system  which  are  shown  in 
Appendix  C. 
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Appendix  A 
Proof  of  Theorem  1 

An  upper  bound  for  V[t)  in  (75)  can  be  formed  by 
first  noting  that  the  skew  symmetry  of  S(-)  implies  that 
rJ)S(u>j!c)rp(t)  =  0  and  e1pS(u)<fc)ep(t )  =  0,  and  then 
specifying  upper  bounds  as 

£i  >  ||~ ~  v?Cd\\  (82) 

and 

£2  >  ||kpvicd||  (83) 

where  E\  and  £2  are  positive  scalar  constants.  An  upper 
bound  for  V(t)  can  now  be  written  as 

V  <  -kr\\rp\\2  -  ke\\ee\\2  -  kp\\ep\\2 +  \\ep\\e1 

+  IM£2  +  IMIKi(-)II  (iHM“)(84) 

Bounds  on  individual  terms  in  (84),  specifically, 

||ep||£i  <  i  (a0  ||ep||2  +  (85) 

where  A0  is  a  positive  scalar  constant, 

IWI£2  <  \  (Ai  ||rj2  +  ^£3)  (86) 

where  Ai  is  a  positive  scalar  constant,  and 

£3>IMIKiOll(lHM^)  (87) 

can  be  used  to  write  a  new  upper  bound  for  V(t)  as 

v  <  -(*v-^)IM2-MMI2 

~(kp  -  4f)  Hep||^  +  +  JjL.  +e3.  (88) 

If  a  positive  scalar  constant  A2  is  selected  according  to 
(78),  then  we  can  obtain 

V  < -X2  ||rp||2  +  ||ee||"  +  ||ep||2  +  ^7  +  5XT+£3,  (89) 

and  then  the  definition  of  77(f)  in  (77)  is  used  to  form  a 
final  upper  bound  on  V(t)  as 

V  <  -A2  |H|2  +  ^  ^  +  £3.  (90) 

The  definition  of  V(t )  in  (67)  can  be  substituted  into 
(90)  to  yield 

V  <  — 2A2V  +  £4  (91) 

where  £4  is  a  new  bounding  constant  introduced  as 


The  solution  to  this  differential  inequality  is 

V  =  V(0)e-2A2t  +  ^  (93) 

and  the  initial  value  of  V  (0)  is  upper  bounded  as 

V(0)  <  i  ||r7(0)||2.  (94) 

Hence,  V(t )  can  be  written  as 

V(t)<l\m\\2e-2X2t  +  ^-2.  (95) 

Relying  again  on  the  definition  of  V(t)  in  (67),  a  bound 
on  77(f)  can  be  written  as 

imi  <  V2 m  (96) 

and  then  (93)  substituted  to  yield 

IMI  <  \/ll^(0)||2  e-2A2*  +  (97) 

which  proves  the  result  in  Theorem  1. 

Remark  2:  According  to  Theorem  1  and  its  subse¬ 
quent  stability  analysis  V  (77(f))  is  bounded  provided  the 
controller  gains  are  selected  to  satisfy  (79).  Based  on 
the  definition  of  in  77(f)  in  (77)  it  is  possible  to  conclude 
that  ep(t),  eg(t),  and  rp(t)  are  bounded.  The  desired 
trajectories,  p\Cd{ f),  vfcd(t),  and  Wjpd(f)  are  bounded 
by  design.  It  was  also  assumed  that  the  quadrotor  pitch 
angle,  9{t)  7^  ±|,  so  that  Tj,(0)  is  invertible  and 
bounded  from  (23)  and  RF(Q)  is  bounded  and  full  rank 
according  to  Assumption  3.  The  rotation  matrix  Rp,{0c) 
is  of  full  rank  and  bounded  as  shown  in  (10),  and  also 
Jc(t)  and  JG(f)  are  full  rank  from  (13)  and  (15).  The 
product  of  Rp(Q)  and  Rp,(9c),  Rq(Q,9c),  is  bounded 
and  full  rank.  Thus,  PjC{t)  in  (30),  p\Cd{ f)  in  (21), 
G(Rp)  in  (5),  and  vfF(t)  in  (37)  are  bounded.  Then 
i’fc( f)  in  (20),  PiC(t)  in  (19),  and  p\F{t)  in  (1)  are 
bounded.  Owing  to  the  desired  trajectory  u)PCd(t)  €  £00, 
QjCd  is  bounded  from  (27).  Since  eg{t)  is  bounded, 
p(t)  €  Too  under  Assumption  3  resulting  in  Lw(f)  € 
in  (44).  Since  vfF{t)  €  £00,  the  nonlinearity  of  the 
aerodynamic  damping  term,  Ni(vfF)  in  (4)  is  upper 
bounded  by  Ci(||wjf||)  by  Assumption  5.  Hence,  U\(t)  € 
£oo  from  (71),  U2(t)  is  bounded  from  (73).  Since  Lu(t) 
and  Rf{6c)  €  £00,  £^(f)  and  L”1^)  are  bounded  from 
(58)  and  (66),  respectively.  Owing  to  the  fact  that  B(t) 
is  invertible  and  bounded  from  (59)  and  B(t)  from  (66), 
and  then  U(t)  in  (61)  is  bounded.  This  yields  that  tt(f), 
u)fF(t),  and  6c(t)  are  all  bounded.  ©}c(f)  in  (26),  OfF(f) 
in  (2),  and  RF( O)  in  (3)  are  all  bounded,  resulting  that 
the  camera  velocity  in  (24),  in  (25),  and 

uccd{ f)  in  (46)  are  all  bounded.  Hence,  we  can  make  a 
conclusion  that  the  time  derivatives  of  errors,  eg(t),  ep(f), 
rp(t),  and  r(f)  in  (43),  (35),  (55),  and  (64),  respectively, 
are  all  bounded.  Finally  vfF(t)  in  the  modeling  equaion 
in  (4)  is  bounded.  Therefore  we  can  conclude  that  all 
the  signals  remain  bounded  in  the  suggested  closed-loop 
system. 


£1  I  £2  I  -  <  P  . 

2A0  ^  2Ai  ^  —  c-4- 


(92) 


Appendix  B 

Kinematics  of  the  3-Link  Camera  Positioner 


The  Denavit-Hartenburg  values  in  Table  I,  II  can  be 
used  in  conjunction  with  the  formula  for  the  rotation 
matrix  from  the  ith  to  (?'  —  l)th  frame  expressed  in  the 
coordinate  system  i—  1,  that  is,  i?-_1(0),  according  to 
[12] 


cos  9 a  —  sin  9 a  cos  at  sin  9a  sin  at. 
sin  9 a  cos  9 a  cos  at  —  cos  9a  sin  at 

0  sin  at.  cos  at 

(98) 

Casel:Tilt-Roll  Camera  Configuration 
(camera  looking  forward) 

All  of  the  rotation  matrices  of  the  Tilt-Roll  camera 
positioning  unit  shown  in  Figure  3  are  obtained  using 
Table  I  and  are  given  by 


R 


1 

2 


and  R3 =c 


cos  9t  0  —  sin  9t 

sin  Qt  0  cos  9t 
0-10 


,  (99) 

(Tilt) 


sin  9p 

—  cos  9P 

0 

sin  9r 

—  cos  9r 

0 


0 

0 

-1 

cos  9 
sin# 
0 


cos  9P 
sin  9V 


aoo) 


0 

r  0 
r  0 
1 


J  (Pan) 

■  (ioi) 

(Boll) 


Tilt-Roll  Camera  Configuration  is  achieved  by  locking 
the  pan  angle  at  9p(t)  =  0.  The  rotation  matrices  i?f  (0) 
and  R2  (0)  are  defined  here  for  computing  (10)  and  (15). 
The  rotation  matrix  from  the  first  link  frame,  O i,  to  the 
quadrotor  frame,  F.  is  obtained  using 


i?f  =  R^Rf=°° 


'  1  0 

0  ' 

cos  9t 

0 

—  sin  9t 

= 

0  0 

1 

sin  9t 

0 

cos  Qt 

0  -1 

0 

0 

-1 

0 

cos  9t 

0 

—  sin  6t 

= 

0 

- 

1 

0 

(102) 

—  sin  9t 

0 

—  cos  9t 

where  the  third  column  in  (102)  is  the  vector  Z\  (/)  in  the 

Jacobian  matrix  Next,  the  rotation  matrix  from 

the  second  link  frame,  O2,  to  the  quadrotor  frame,  F,  is 

obtained  using 

tdF  _  pF  pi 

K2  —  ±i\  -rt2 


cos  9t 

0 

—  sin  9t 

0 

0 

1  ' 

0 

-1 

0 

-1 

0 

0 

—  sin#t 

0 

—  cos  9t 

0 

-1 

0 

0  sin  9t  cos  9t 

1  0  0 
0  cos  9t  —  sin  Qt 


(103) 


where  the  third  column  in  (103)  is  the  vector  Z2  (/)  in 
the  Jacobian  matrix  Jc{t). 


Case2:Pan-Tilt,  Camera  Configuration 
(camera  looking  downward) 

The  Denavit-Hartenburg  values  in  Table  II  are  used 
to  obtain  the  rotation  matrices  of  the  Pan-Tilt  camera 
positioner  configuration. 


Link 

d  (offset) 

a  (length) 

at  (twist) 

6a  (angle) 

1 

0 

0 

-90° 

6t  -  90° 

2 

0 

0 

-90° 

6P  -  90° 

3 

0 

0 

0° 

Ob 

-3 

1 

CO 

0 

0 

TABLE  II 


Denavit-Hartenburg  Table  for  a  Pan-Tilt  Camera  Positioner 


The  rotation  matrices  of  the  Pan-Tilt  camera  position¬ 
ing  configuration  shown  in  Figure  3  are  given  by 


rb=O0 


R 


1 

2 


and  /it. _ pi 


sin  9t 
—  cos  9t 
0 


sin  9P 
—  cos  9P 


0 


sin  9r 
—  cos  9r 

0 


0 

0 

-1 

0 

0 

-1 

cos  9 
sin# 
0 


cos  9t 

sin#t  (104) 

0  J  (Tilt) 


cos  9P 
sin  9P 


(105) 


0 

T.  0 

r  0 

1 


J  (Pan) 

•  (106) 

(Boll) 


Pan-Tilt  camera  configuration  is  achieved  by  locking  the 
roll  angle  at  9r(t)  =  0°  in  (106),  then  we  have 


R 


2 

3 


0  1  0 
-10  0 


(107) 


The  rotation  matrix  i?|J(0)  has  same  matrix  in  (8).  The 
rotation  matrix  from  the  quadrotor  frame  (F)  to  first 
link  frame  0 1  is  obtained  by  multiplying  the 


= 


1  0 

0  0 

0  -1 


sm  Vt 
0 
cos 


0 
1 
0 

0 
-1 

0t  0 


sin  9t 

0 

cos  Qt 

—  cos  Qt 

0 

sin  9t 

0 

-1 

0 

cos  9t 
0 

—  sin  9t 


(108) 


where  the  third  column  in  (108)  is  the  second  vector 
in  the  Jacobian  matrix  Jc(t).  Next,  the  rotation  matrix 
from  the  quadrotor  frame  through  the  second  link  yields 

tdF  _  pF  pi 

-TL2  —  -til  H 2 


sin  Qt  0 

cos  9t 

sin  Qp 

0 

cos  9P 

= 

0  -1 

0 

—  cos  9P 

0 

sin  9P 

cos  Qt  0 

—  sin  Qt 

0 

-1 

0 

sin  9t  sin  9p 

—  cos  Qt 

sin  Qt  cos  9p  1 

= 

cos  9P 

0 

—  sin  9p 

cos  Qt  sin  9P 

sin  Qt 

cos  Qt  cos  9P 

(109) 

where  the  third  column  is  the  third  vector  in  the  Jacobian 
matrix  for  Pan-Tilt,  manipulator.  Then,  we  can  obtain 


the  total  rotation  matrix  by  combining  all  those  matrices 
from  quadrotor  through  the  3rd  link  to  yield 


RFc  = 


cos  6t 
0 

—  sin  9t 


sin  9t  sin  9P  sin  Qt  cos  9P 


COS  9  r, 


—  sin(L 


/p  JXXXWp 

cos  9t  sin  9P  cos  9t  cos  0P 


(110) 


/  P  CyWO  1/ J  V^VU  l/p 

The  Jacobian  matrix  of  the  Pan-Tilt  camera  manipula¬ 
tor,  Jc(Q)  €  R3x3,  can  be  represented 


Jc 

0'c 


0 

1 

0 

0t 

Op 

9r 


cos  9t  sin  9t  cos  9P 
0  —  sin  9P 

—  sin  9t  cos  9t  cos  9P 

-  T 

where  0r(t)  =  0°. 


(111) 

(112) 


To  simplify  the  use  of  the  Jacobian  matrix,  it  can  be 
noted  that  9r[t)  =  0°  and  hence  a  new  reduced  position 
joint  angle  vector  can  be  introduced  as 


0c 


0P 


€  R2  and  9c  = 


€  R2 


(113) 


along  with 
defined  as 


a  reduced  Jacobian  matrix,  Jc(©)  €  R3x2, 


Jc 


0  cos  Qt 
1  0 
0  —  sin  9t 


(114) 


Appendix  C 
Simulation  Results 


Simulation  results  are  obtained  as 
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Fig.  8.  position  tracking 


Position  x  Error  in  Body-fixed  Frame 


Fig.  7.  position  tracking  errors 


Fig.  9.  filtered  tracking  errors 
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Fig.  12.  velocity  tracking 


Fig.  10.  Control  Inputs 


Velocity  x-axis  Error  in  Body-fixed  Frame 


Angular  Velocity  Tracking  about  y  in  Body-fixed  Frame 


Fig.  11.  velocity  tracking  errors 


Fig.  13.  angular  velocity  tracking 
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Fig.  14.  eTheta 
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Fig.  16.  UAV  orientation 
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